Electronic Version 
Stylesheet Version vl.1.1 

Description 

METHOD FOR PERFORMING PREDICTIVE 

PICTURE DECODING 

Background of Invention 

[0001] The present invention relates to a metliod for performing 
predictive picture decoding, and more specifically, to a 
method for accessing a plurality of prediction units of a 
picture in a memory device. 

[0002] In 1988, the Motion Picture Experts Group (MPEG) was es- 
tablished. MPEG is an International Standard Organization 
(ISO) work group, which established digital video and au- 
dio compression standards. These standards are now be- 
ing widely used in the industry. Since its establishment in 
1988, MPEG has published several important standards. 
MPEG-2 and MPEG-4 are two outstanding video compres- 
sion standards. Fig.l illustrates a portion of the MPEG-4 
video decoder. The decoder 10 in Fig.l includes a variable 
length decoder 12, an inverse scanner 14, an inverse DC/ 
AC prediction module 16, an inverse quantization unit 18, 



an inverse DCT 20 and a motion compensation unit 22. 
The variable length decoder 12 performs variable length 
decoding on the input compressed video bitstream. The 
inverse scanner 14 performs inverse scanning and con- 
verts the one-dimensional array into a two-dimensional 
array. The inverse DC/AC prediction module 16 will be 
described later. The inverse quantization unit 18 receives 
the two-dimensional array and produce frequency domain 
DCT coefficients. Then, the inverse DCT converter 20 re- 
ceives the DCT coefficients, produces many non-zero 
outputs, and converts frequency domain signals to spatial 
domain signals. Finally the motion compensation unit 22 
applies motion compensation to the received data. 
[0003] The inverse DC/AC prediction module 16 is one of the 

major technical features of the MPEG-4 decoder 10. Fig. 2 
is a diagram showing operation of the inverse DC/AC pre- 
diction module 16 according to the related art. Fig. 2 fol- 
lows the structure in Fig.l to explain the two-dimensional 
array produced by the inverse scanner 14, which will go 
through a prediction operation in the inverse DC/AC pre- 
diction module 16, and the pixel coefficients for the whole 
picture will further be decoded on the two-dimensional 
space. In the process in the inverse DC/AC prediction 



module 16, the whole picture is divided into a plurality of 
8*8 pixel sized blocks. The pixel coefficient of the next 
newly decoded block is produced by sending partial pixel 
coefficients of the block which was decoded previously 
from the prediction selection unit 24 into the inverse DC/ 
AC prediction module 16, combined with the differential 
value calculated by the variable length decoder 12. For an 
explanation of the operation of the inversion DC/AC pre- 
diction module 16 and prediction selection unit 24 on the 
picture in Fig. 2, please refer to Fig. 3. Fig. 3 is a diagram il- 
lustrating the process of a macro-block 32 in a picture 30 
in the above-mentioned process. In the MPEG standard to 
compress video, the basic processing unit is an 8*8 pixel 
sized block. A macro-block 32 contains four blocks, and 
therefore includes 16*16 pixels. MPEG video compression 
standard uses luminance (Y) and chrominance (Cr, Cb) to 
represent color. In this example, the macro-block refers 
to the luminance macro-block. Therefore, if the chromi- 
nance data is sampled at half the sample rate of the lumi- 
nance data along a horizontal direction and a vertical di- 
rection, original 16x16 pixels are sampled and the sam- 
pled luminance and chrominance data are encoded to 
generate one luminance macro-block (Y) having lumi- 



nance information corresponding to the 16x16 pixels and 
two chrominance blocl<s (Cr and Cb) each having chromi- 
nance information corresponding to half the 16x16 pixels. 
[0004] Please refer to Fig. 3. The macro-block 32 includes a first 
block B, a second block C, a third block A and a fourth 
block X that is to be decoded. To decode the fourth block 
X, a plurality of predictors will be defined in the neighbor- 
ing blocks (the first block B, the second block C and the 
third block A). The plurality of predictors can be classified 
as DC coefficients and AC coefficients according to the 
spatial configuration in each block. As shown in Fig. 3, the 
first block B, the second block C and the third block A 
each contain a DC coefficient respectively denoted as DC^, 
DC , DC (the shaded squares in the Fig.). As for the 

C A 

fourth block X, in the current prediction operation, the 
second block C contains a plurality (seven) other AC coef- 
ficients: AC^(ln two-dimensional representation: AC 
^[0][n], n is an integer from 1 to 7). In the same manner, 
the third block A contains a plurality (seven) other AC co- 
efficients: AC^(ln two-dimensional representation: AC 
[n][0], n is an integer from 1 to 7). Since there are two 

A 

possible sources for some of the pixel coefficients in the 
fourth block X, from the upper second block C or from the 



third blocl< A on tlie left, to determine if the source of the 
pixel coefficient in fourth block X is the predictor in the 
second block C or the third block A, a DCAC direction 
vector must be determined from the following equation: 
[0005] I DC - DC I < I DC - DC I Equation (1) 

A B B C ^ 

[0006] If Equation (1) holds, then the prediction selection unit 24 
in Fig. 2 will determine that the partial pixel coefficients in 
the fourth block X are from the second block C, and will 
decide a first DCAC direction vector Ml. On the contrary, 
if Equ.l does not hold, then the partial pixel coefficients 
in the fourth block X will be determined to come from the 
third block A and decides a second DCAC direction vector 
M2. After deciding the source for the predictors and the 
DCAC direction vector, the inverse AC/DC prediction 
module 16 in Fig. 2 will add a DC differential value to the 
DC coefficient of the source block and set this value to be 
the DC coefficient (DC ) of the fourth block X, which is 
shown in Fig. 3 as the first pixel coefficient for the fourth 
block X; then the prediction selection unit 24 in Fig. 2 will 
send the AC coefficient of the predictor from the source 
block to the inverse DC/AC prediction module 16, adding 
an AC differential value to the AC coefficient and then set- 
ting the value to be the AC coefficient to the fourth block 



X. The AC coefficient is at tlie first access row or tlie first 
access column in tlie fourtli blocl< X. For example, if the 
source is the upper second block C, the inverse DC/AC 
prediction module 16 will add the DC and AC differential 
value calculated from the variable length decoder sepa- 
rately to DC and AC of the second block C, then set the 
result to be the pixel coefficient of the first access row 
(33) in the fourth block X and sequentially decode the 
whole fourth block. In the same manner, if the source is 
the third block A on the left, the inverse DC/AC prediction 
module 16 will add the DC and AC differential value cal- 
culated from the variable length decoder 12 separately to 
DC and AC of the third block A, then set the result to be 

A A 

the pixel coefficient of the first access column (35) in the 
fourth block X and sequentially decode the whole fourth 
block. 

[0007] It can be known from the above that the MPEG-4 com- 
pression standard derives the partial pixel coefficients for 
the block to be decoded from the predictors in the spa- 
tially neighboring decoded block. For the whole picture 
30, sequentially processing each block according to the 
above-mentioned method will produce the pixel coeffi- 
cients for the whole picture. Since in the process of de- 



coding, predictors are decided continuously for tlie blocic 
to be decoded, such tliat the system (the decoder 10 
shown in Fig.l and Fig. 2) must be equipped with at least 
one memory device to store the plurality of predictors. To 
derive a complete process of prediction operation, the ex- 
ample in Fig. 4 will describe the decoding of a macro- 
block 42 and observe the number of predictors to be 
stored in the process. Please refer to Fig. 4. Fig. 4 is a dia- 
gram of an embodiment according to the related art. It is 
slightly differently defined comparing to the embodiment 
in Fig. 3. This embodiment contains a first block X, a sec- 
ond block Y, a third block X' and a fourth block Y' which 
compose a macro-block 42 to be decoded. Surrounding 
these 4 blocks are a reference block B, a first adjacent 
block A, a second adjacent block C, a third adjacent block 
C and a fourth adjacent block A'. Please refer to the 
structure in Fig. 2. Following the method in the embodi- 
ment in Fig. 3, which produces the data for the block to be 
decoded from the upper and left adjacent blocks, when 
processing the first block X, a predictor from the upper 
left reference block B (DC ), eight predictors from the first 

B 

adjacent block A on the left (one DC^ and seven AC 
[0][l-7]), and eight predictors from the second adjacent 

A 



block C on the top (one DC and seven AC [l-7][0]) must 
be provided. The prediction selection unit 24 in Fig. 2 will 
then determine where the predictor comes from based on 
DC , DC and DC , and send the rest of the AC coeffi- 

B c A 

cients to the inverse DC/AC prediction module 16 in Fig. 2, 
which will then be combined with the differential value 
from the variable length decoder 12 to produce the pixel 
coefficient for the first block X. This means that to decode 
the first block X, the system has to be equipped with a 
memory device that has a storage size large enough to 
store 17 (17=1+8+8) predictors. After the first block X 
has completed encoding, before processing the second 
block Y, since the second block Y is adjacent to the first 
Block X and the third adjacent block C, the left most col- 
umn of the first block X has to be set as the predictor and 

then the DC of the second adjacent block C, DC and AC 

c X 

[1-71[01 of the first block X and DC . and AC .[0][l-7] of 
third adjacent block C will be used to decide the partial 
pixel coefficients for the second block Y. In the same 
manner, DC of the first adjacent block A, DC and AC 

A X 

[0][l-7] of the first block X and DC . and AC .[l-7][0] of 

X A A 

the fourth adjacent block A' can decide the partial pixel 
coefficients for the third block X'. DC of the first block X, 

X 



DC and AC [0][l-7] of the second block Y and DC and 

Y Y X ' 

AC ,[l-7][0] of the third block X' can decide the partial 

X 

pixel coefficients for the fourth block Y'. 

[0008] For each macro-block 42 (including one luminance 

macro-block 32(16X16 pixel), one Cb chrominance block 
(8X8 pixel) and one Cr chrominance block (8X8 pixel)), the 
above prediction operation and decoding process can be 
concluded as shown in Fig. 5, which is a flowchart of an 
embodiment according to the related art. 

[0009] Step 100: Start; 

[0010] Step 101: When processing any block in the macro-block 
(such as a first block X in Fig. 4), determine if there are any 
predictors to be processed by the prediction operation. 
(For example, for the first block X in Fig. 4, the required 
predictor includes predictor DC^ from the reference block 

B, DC and AC [0][l-7] from the first adjacent block A, 

A A 

and DC and AC [l-7][0] from the second adjacent block 

C. ) If they exist, proceed to step 103, else proceed to step 
102; 

[0011] Step 102: Configure the predictors required to decode the 
block in a predefined way. If the DC coefficient being con- 
figured is a fixed value, then the required AC coefficient is 
0. Proceed to step 104 after the configuration; 



[0012] Step 103: Determine and confirm tlie source of tlie pre- 
dictor and a corresponding DCAC direction vector and 
produce the required predictor to decode the block. In the 
actual implementation, the predictor can be retrieved from 
the memory device in the system for storing predictors. 
Proceed to step 104; 

[0013] Step 104: Produce the DC coefficient for the block to be 
decoded by adding one DC coefficient from a plurality of 
predictors to a DC differential value calculated by the vari- 
able length decoder; then produce the AC coefficient for 
the block to be decoded by adding one AC coefficient 
from a plurality of predictors to an AC differential value 
calculated by the variable length decoder and put the re- 
sult into the first access row and the first access column 
of the block to be decoded; 

[0014] Step 105: Use a counter and add one to the value (integer) 
in the counter; 

[0015] Step 106: Determine if the block counter value in the 

counter is greater than four. If not, go back to step 101 
and continue processing the other blocks in this macro- 
block. If the block counter value in the counter is greater 
than four, this shows that the four blocks in the current 
macro-block have all been processed, and proceed to step 



107; 

[0016] Step 107: Execute the prediction operation and decoding 
procedure over the 8X8 pixel sized Cb chrominance block 
and the 8X8 pixel sized Cr chrominance block; and 

[0017] Step 108: End the prediction operation and decoding pro- 
cedure in the current macro-block and jump to the next 
macro-block. 

[0018] Parts of the above-mentioned related art were specified in 
the MPEG-4 video compression standard and related 
methods and structures were publicized in US Patent No. 
6,005,622, Video coder providing implicit or explicit pre- 
diction for picture coding and intra coding of video" by 
Haskell et al, which is hereby incorporated by reference. 
Please note that in the related art described in Fig. 4, the 
predictors have to be produced continuously for use with 
the block to be decoded during the prediction operation 
and decoding process, the system has to be equipped 
with at least one memory device to store a plurality of 
predictors. According to the embodiment described in 
Fig. 4, overall in any block in each macro-block, the pixel 
coefficient in the left most column and the top most row 
will be decided as predictors; to decode such a macro- 
block, the system must be configured with a memory de- 



vice with storage size witli at least tlie size of 17*6 (four Y 
blocks, one Cb block and one Cr block) predictors. Fol- 
lowing the conclusion, to decode all pixel coefficients in a 
picture over the two-dimensional space, the number of 
predictor access is formidable. For example, in a 720x480 
pixel picture, there are approximately 45*30*17*6 predic- 
tors to be decided. This means that the memory device in 
the system must be large enough to hold the vast number 
of predictors. But in a technology according to the related 
art that is based on software to process the decoding pro- 
cedure (such as disclosed in US Patent No. 6,005,622), 
memory size was not so critical. Yet in the present indus- 
trial trend to integrate a video codec in a single hardware 
unit, such huge amount of memory will lead to very high 

cost for an on-chip configuration in the system. 
Summary of Invention 

[0019] It is therefore one of the objectives of the invention to 

provide a method for accessing a plurality of predictors of 
a picture using less memory to solve the above-men- 
tioned problems. 

[0020] According to an embodiment of the present invention, a 
predictive decoding method for decoding a picture to 
generate a plurality of predictors of a plurality of blocks 



within tlie picture is disclosed. Tlie predictive decoding 
metliod comprises (a) storing a plurality of first vertical 
predictors of a first block into a storing column of a first 
memory device, and storing a plurality of first horizontal 
predictors of a second block into a storing row of the first 
memory device; (b) performing a prediction operation for 
generating a plurality of target vertical predictors and a 
plurality of target vertical predictors of a first target block 
according to the first vertical predictors and the first hori- 
zontal predictors, wherein the first target block is adja- 
cent to the first and second blocks, and the first block and 
the first target block are located at the same row; and (c) 
updating the storing column of the first memory device by 
the target vertical predictors, and updating the storing 
row of the first memory device by the target horizontal 
predictors. 

[0021] In addition, a method for storing a plurality of predictors 
of a macro-block into a first memory device and a second 
memory device is disclosed according to an embodiment 
of the present invention. The macro-block comprises a 
first block, a second block, a third block, and a fourth 
block. The method comprises (a) generating a plurality of 
predictors of the first block according to a first adjacent 



block and a second adjacent block; (b) after proceeding 
with step(a), storing the predictors of the first block into 
the first memory device; (c) after proceeding with step(b), 
generating a plurality of predictors of the second block 
according to a third adjacent block and the first block; (d) 
after proceeding with step(c), storing the predictors of the 
second block into the first memory device; (e) after pro- 
ceeding with step(d), generating a plurality of predictors 
of the third block according to a fourth adjacent block and 
the first block; (f) after proceeding with step(e), storing 
the predictors of the third block into the first memory de- 
vice and the second memory device; (g) after proceeding 
with step(f), generating a plurality of predictors of the 
fourth block according to the second block and the third 
block; and (h) after proceeding with step(g), storing the 
predictors of the fourth block into the first memory device 
and the second memory device. 
[0022] According to the embodiment, the picture could be a 
frame, a top field, or a bottom field, as defined in the 
MPEG standard. For progressive video, a picture is identi- 
cal to a frame, while for interlaced video, a picture can re- 
fer to a frame, or the top field or the bottom field of the 
frame depending on the context. 



[0023] These and other objectives of the invention will no doubt 

become obvious to those of ordinary skill in the art after 

reading the following detailed description of the preferred 

embodiment, which is illustrated in the various figures 

and drawings. 
Brief Description of Drawings 

[0024] Fig.l is a partial functional block diagram of a related art 
decoder. 

[0025] Fig. 2 is a diagram of an embodiment in Fig.l. 

[0026] Fig. 3 is a diagram illustrating the execution of predictive 
decoding on a macro-block in a picture according to the 
related art. 

[0027] Fig. 4 is a diagram of an embodiment according to the re- 
lated art. 

[0028] Fig. 5 is a flowchart of an embodiment according to the 
related art. 

[0029] Fig. 6 is a spatial allocation diagram of a picture. 

[0030] Fig. 7 is a diagram of an embodiment according to the in- 
vention. 

[0031] Fig. 8 is a flowchart of a detailed embodiment according to 
the invention. 

[0032] Fig. 9 is a flowchart of another embodiment in Fig. 8. 



[0033] Fig. 10 is a table illustrating the content changes of the 
access row , the access column and the additional mem- 
ory cell in the memory device shown in Fig. 7. 
Detailed Description 

[0034] According to the embodiment, the video bistream in- 
cludes a plurality of pictures, and the picture could be ei- 
ther a frame, a top field, or a bottom field as defined in 
the MPEG standard. The picture is divided into a plurality 
of macro-blocks 52 each having 16*16 pixels, and each 
macro-block 52 is regarded as a processing unit. Fig. 6 is 
a spatial allocation diagram of a picture. The picture 50 
includes a plurality of macro-block rows 51, where each 
macro-block row 51 includes a plurality of macro-blocks 
52 and every macro-block 52 includes four 8*8 pixel 
sized blocks. For example, for a 720X480 pixel sized pic- 
ture 50, there are thirty macro-block rows 51, where ev- 
ery macro-block row 51 includes fourty-five macro- 
blocks 52. Also, the arrow MRl in Fig. 6 indicates that the 
order for processing the macro-blocks 52 in a macro- 
block row 51 is from the left to the right. According to the 
embodiment shown in Fig. 4, the macro-block 52 is a lu- 
minance macro-block. If the chrominance data is sampled 
at half the sample rate of the luminance data along the 



horizontal and vertical directions, two 8x8 pixel sized 
chrominance blocks (Cr and Cb) 53, 55 corresponding to a 
macro-block 52 are processed before a following 16x16 
pixel sized macro-block 52 is decoded. 
[0035] Fig. 7 illustrates an embodiment of the invention. The dia- 
gram describes the technical feature of the invention, 
which utilizes a memory device for accessing the predic- 
tors to reduce the amount of storage space needed for re- 
lated memory devices. Similar to the definition in the prior 
embodiment example in Fig. 4, the macro block 52 to be 
decoded in this embodiment includes a first block X", a 
second block Y", a third block X'", and a fourth block Y'". 
Surrounding these four blocks are a reference block B', a 
first adjacent block A', a second adjacent block C, a third 
adjacent block C" and a fourth adjacent block A". Please 
note that in Fig. 7, a memory device 56 having an access 
column 56C and an access row 56R for storing the predic- 
tors produced during the prediction decoding procedure 
is shown. For simplicity, each memory cell in the memory 
device 56, such as each block in the access column 56C 
and the access row 56R shown in Fig. 7, is capable of stor- 
ing one predictor. According to the MPEG-4 video com- 
pression standard rules, when processing the block to be 



decoded, the data is derived from predictors in tlie adja- 
cent blocl<s. Please refer to Fig. 7, wlien processing tlie 
first block X", the system will have to provide one predic- 
tor (DCg ,) from the reference block B' on the upper left, 
eight predictors (one DC^ , and seven AC^ ,[l-7][0]) from 
the first adjacent block A' on the left side and eight pre- 
dictors (one DC , and seven AC ,[0][l-7]) from the sec- 
ond adjacent block C on the upper side. 
[0036] In this embodiment, we divide the predictors according to 
their spatial positions into three categories: vertical pre- 
dictors, horizontal predictors and diagonal predictors. For 
example, eight predictors at the same column in the first 
adjacent block A' (including AC '[l-7][0], and DC ') are 
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regarded as vertical predictors. Eight predictors at the 
same row in the second adjacent block C (including AC 
^'[0][l-7] and DC^' ) are regarded as horizontal predictors. 
The predictor DC , at the top-left corner in the reference 
block B' is regarded as a diagonal predictor. In this em- 
bodiment, the predictor at the top-left corner of each 
block is defined to be a diagonal predictor for another 
block. For instance, the predictor DC^ . of the reference 
block B' is a diagonal predictor for the first block X", and 
the predictor DC , of the second adjacent block C is a di- 



agonal predictor for the second block Y". In other words, 
one of the horizontal predictors of one block also func- 
tions as a diagonal predictor for another block, and/or 
one of the vertical predictors of one block also functions 
as a diagonal predictor for another block. The eight mem- 
ory cells of the access row 56R (defined as 56R[0-7]) will 
store the eight horizontal predictors from the second ad- 
jacent block C; the eight memory cells of access column 
56C (defined as 56C[0-7]) will store the eight vertical pre- 
dictors from the first adjacent block A'. There is another 
memory cell 56D in the memory device 56 reserved to 
store the diagonal predictor DC^ , of the reference block 
B". 

[0037] Also refer to Fig. 7. After the system has determined the 
source of the predictor based on DC , DC , and DC 

^ B C ' A', 

the rest of the AC coefficients will be combined with the 
related differential values to produce the pixel coefficient 
of the first block X". (Please refer to the embodiment in 
Fig. 2 according to the related art for the flow of the oper- 
ation for combining with the differential values.) Next, to 
complete the rest of the prediction decoding of the 
macro-block 52, the pixel coefficient of the left most col- 
umn and top most row of the first block X" will be set as 



predictors, and stored into tlie memory device 56. In tiiis 
embodiment, tlie newly decided (horizontal) predictors DC 
„ and AC „ [0][l-7] of the first block X" will replace the 
eight horizontal predictors of the second adjacent block C 
(previously stored in the access row 56R[0-7]) and be 
stored in the access row 56R[0-7]. In the same manner, 
the newly decided (vertical) predictors DC „„ and AC 
„[l-7][0] of the first block X" will replace the eight vertical 
predictors of the first adjacent block A' (previously stored 
in the access column 56C[0-7]) and be stored in the ac- 
cess column 56C[0-7]. Thus, there is no additional stor- 
age space waste by replacing in the memory device 56. 
After completing the decoding of first block X", the sec- 
ond block Y" will be processed immediately. Since the 
second block Y" is adjacent to the first block X" and the 
third adjacent block C", the predictor source will be deter- 
mined by DC , DC and DC . And then DC and AC 
,.[l-7][0] of the first block X" and DC^ .and AC^ ..[0][l-7] 
of third adjacent block C" will be used to decide the par- 
tial pixel coefficients and the predictors of the second 
block Y". Afterwards, the newly decided (horizontal) pre- 
dictors DC^ „ and AC^ „[0][l-7] of the second block Y" will 
replace the eight horizontal predictors of the third adja- 



cent block C" (previously stored in the access row 
56R[8-15]) and be stored in the access row 56R[8-15]. 
And the newly decided (vertical) predictors DC^ „ and AC^ 
„[l-7][0] of the second block Y" will replace the DC „ and 

X 

AC „[l-7][0] of the first block X" which were stored into 

X 

the access column 56C[0-7] in the previous operation, 
and be stored into the access column 56C[0-7]. 
[0038] In the same manner, after DC of the first adjacent block 
A', DC and AC [0][l-7] of the first block X" and DC 
and AC „[l-7][0] of the fourth adjacent block A" decide 
the partial pixel coefficients of the third block X'", the 
predictor DC^ ,„, predictors AC^ ,„[0][l-7] and predictors 
AC^ .„[1-71[01 of the third block X'" will be decided and the 
newly decided predictors DC ,„ and AC ,„[l-7][0] will re- 

X X 

place the eight vertical predictors of the fourth adjacent 
block A" which were stored in the access column 
56C[8-15] and be stored in the access column 56C[8-15]. 
And DC of the first block X", DC and AC [0][l-7] of 
the second block Y", and DC and AC [l-7][0] of the 
third block X'" will decide the partial pixel coefficients of 
the fourth block Y'", then the predictor DC^ ... of the fourth 
block Y'", the predictors AC^ ,„[0][l-7] and the predictors 
AC^ ,„[l-7][0] will be decided and the newly decided pre- 



dictors DC and AC [l-7][0] will replace the DC and 
AC^ ,„[l-7][0] of the third block X'" in the access column 
56C[8-15] in the previous operation and be stored in the 
access column 56C[8-15]. 

[0039] This embodiment stores the vertical predictors, the hori- 
zontal predictors and the diagonal predictor into the ac- 
cess column 56C, the access row 56R, and an additional 
memory cell 56D of the memory device 56, utilizing a 
swap and replace method to minimized storage space us- 
age in the memory device 56. In an actual implementa- 
tion, the memory device 56 can be a processing register, 
or even be an ordinary register if the hardware perfor- 
mance permits. The embodiment accesses a plurality of 
predictors of a picture 50 using a memory device 56, and 
the procedure of the predictive decoding is illustrated in 
the following eight steps, as shown in Fig. 8 according to 
the embodiment. 

[0040] Step 200: Start; 

[0041] Step 201: When processing a first block X" in a macro- 
block 52, refer to the neighboring blocks for producing a 
plurality of predictors for the first block X", and proceed 
to step 202. The plurality of predictors include horizontal 
predictors, vertical predictors and a diagonal predictor. 



Referring to Fig. 7, tlie first blocl< is located in tlie upper 
left of the macro-block 52. The neighboring blocks in- 
clude a reference block B' located on the upper-left side 
to the first block X", a first adjacent block A' located on 
the left to the first block X", and a second adjacent block 
C located on the upper side to the first block X"; 

[0042] Step 202: Store the vertical predictors into the access col- 
umn 56C[0-7], store the horizontal predictors into the ac- 
cess row 56R[0-7], and store one diagonal predictor into 
the above-mentioned additional memory cell 56D. Pro- 
ceed to step 203. The newly calculated horizontal predic- 
tors of the first block X" will replace the horizontal predic- 
tors of the second adjacent block C previously stored in 
the access row 56R[0-7]. The newly calculated vertical 
predictors of the first block X" will replace the vertical 
predictors of the second adjacent block C previously 
stored in the access column 56C[0-7]. The diagonal pre- 
dictor DC^ , for the second block Y" will replace the diago- 
nal predictor DC^, for the first block X" previously stored 
in the additional memory cell 56D; 

[0043] Step 203: When processing a second block Y" in a macro- 
block 52, refer to the neighboring blocks for producing a 
plurality of predictors for the second block Y", and pro- 



ceed to step 204. The plurality of predictors include hori- 
zontal predictors, vertical predictors and a diagonal pre- 
dictor. Referring to Fig. 7, the second block is located in 
the upper right of the macro-block 52. The neighboring 
blocks include the second neighboring block C located on 
the upper-left side to the second block Y", the first block 
X" located on the left to the second block Y", and a third 
adjacent block C" located on the upper side to the second 
block Y"; 

[0044] Step 204: Store the vertical predictors (a total of eight) of 
the second block Y" into the access column 56C[0-7], 
store the horizontal predictors (a total of eight) into the 
access row 56R[8-15], and store one diagonal predictor 
into the additional memory cell. Proceed to step 205. The 
newly calculated horizontal predictors of the second block 
Y" will replace the horizontal predictors (a total of eight) 
of the third adjacent block C" previously stored in the ac- 
cess row 56R[8-15]. The newly calculated vertical predic- 
tors of the second block Y" will replace the vertical pre- 
dictors (a total of eight) of the first block X" previously 
stored in the access column 56C[0-7] in step 202. The di- 
agonal predictor DC^for the third block X"' will replace 
the diagonal predictor DC . for the second block Y" previ- 



ously stored in the additional memory cell 56D; 

[0045] Step 205: When processing a third block X'" in a macro- 
block 52, refer to the neighboring blocks for producing a 
plurality of predictors for the third block X'", and proceed 
to step 206. The plurality of predictors include vertical 
predictors and a diagonal predictor. Referring to Fig. 7, 
the third block is located in the lower left of the macro- 
block 52. The neighboring blocks include the first adja- 
cent block A' located on the upper-left side to the third 
block X'", a fourth adjacent block A" located on the left to 
the first block, and the first block X" located on the upper 
side to the third block X'"; 

[0046] Step 206: Store the vertical predictors into the access col- 
umn 56C[8-15], and store one diagonal predictor into the 
additional memory cell. Proceed to step 207. The newly 
calculated vertical predictors of the third block X'" will re- 
place the vertical predictors of the fourth adjacent block 
A" previously stored in the access column 56C[8-15]. The 
diagonal predictor DC^ „for the fourth block Y'" will re- 
place the diagonal predictor DC^, for the third block X'" 
previously stored in the additional memory cell 56D. 

[0047] Step 207: When processing a fourth block Y"' in a macro- 
block 52, refer to the neighboring blocks for producing a 



plurality of predictors for the fourth block Y'" and proceed 
to step 208. The plurality of predictors include vertical 
predictors and a diagonal predictor. Referring to Fig. 7, 
the fourth block is located in the lower right of the 
macro-block 52. The neighboring blocks include the first 
block X" located on the upper-left side to the fourth block 
Y'" the third block X" located on the left to the fourth 
block Y'" and the second block Y" located on the upper 
side to the fourth block Y'"; 

[0048] Step 208: Store the vertical predictors to the access col- 
umn 56C[8-15], and store one diagonal predictor to the 
additional memory cell 56D. Proceed to step 209. The 
newly calculated vertical predictors of the fourth block Y'" 
will replace the vertical predictors of the third block X'" 
previously stored in the access column 56C[8-15]. The di- 
agonal predictor DC^„ for a first block of a following 
macro-block will replace the diagonal predictor DC „ for 
the fourth block Y'" previously stored in the additional 
memory cell 56D. 

[0049] Step 209: Perform the predictive operation and decoding 
procedure over an 8x8 pixel sized Cb chrominance block 
and an 8x8 pixel sized Cr chrominance block; and 

[0050] Step 210: Complete the predictive operation and decoding 



procedure of the macro-block 52. Proceed to the next 
macro- block. 

[0051] According to the flow diagram in Fig. 8, and referring to 
the spatial configuration in Fig. 6, the predefined order of 
the embodiment to process the macro-block 52 can be 
known (as shown by the arrow MR2). Thus when process- 
ing each macro-block 52, the four blocks are processed in 
a Z shaped order. And after completing this (16x16 pixel 
sized) luminance macro-block 52, the two corresponding 
8x8 pixel sized chrominance blocks (Cr and Cb) will be 
processed. After completing the processing of a macro- 
block 52, proceed to the next macro-block 52 in the same 
macro-block row, from the left to the right (as shown by 
arrow MRl), thus processing every macro-block in the 
macro-block row. From the above, it is known that the 
processing order of the macro-blocks is from the left to 
the right in a macro-block row 51. Therefore when the 
system completes processing a macro-block 52, the 
macro-block 52 located beneath the currently processed 
macro-block 52 is not processed immediately. Therefore, 
it is not necessary to save the horizontal predictors (DC „, 
and AC^.„[0][l-7]) of the third block X'" and the horizontal 
predictors (DC „. and AC ...[0][l-7]) of the fourth block Y"' 



into the memory device 56 because these horizontal pre- 
dictors are merely helpful to these macro-blocks 52 that 
are located beneath the currently processed macro-block 
52 and still awaiting to be processed. This is why in Fig. 8, 
the steps in the flow diagram do not include "The newly 
calculated horizontal predictors of the third block X'" will 
replace the horizontal predictors of the first block X" pre- 
viously stored in the access row 56R[0-7]" and/or "The 
newly calculated horizontal predictors of the fourth block 
X'" will replace the horizontal predictors of the second 
block Y" previously stored in the access row 56R[8-15]". 
In this embodiment, there is another secondary memory 
device 58 in Fig. 9. The secondary memory device 58 can 
be implemented by a DRAM, an SRAM or registers to store 
the horizontal predictors of the third (lower left) and the 
fourth (lower right) block of every macro-block 52. After 
all macro-blocks 52 have been completely processed in a 
macro-block row, the predictors stored in secondary 
memory device 58 can then be used to execute predictive 
decoding procedure for the macro-blocks 52 in the next 
macro-block row. Please refer to Fig. 9, which is the flow 
diagram for another embodiment of Fig. 8, with additional 
steps to be performed on the secondary memory device. 



[0052] Step 211: In step 206 of Fig. 8, store the horizontal pre- 
dictors of the third block in the secondary memory device. 

[0053] Step 212: In step 208 of Fig. 8, store the horizontal pre- 
dictors of the fourth block in the secondary memory de- 
vice. 

[0054] According to the disclosure in the embodiment of Fig. 7, 
the replacing of the content in the access column 
56C[0-7], access column 56C[8-15], access row 56R[0-7] 
and access row 56R[8-15] is listed in Fig. 10. In the pro- 
cess of prediction operation and decoding, even if predic- 
tors are decided continuously for use by the macro-block 
to be decoded, the embodiment can complete the predic- 
tive decoding with far less memory space then the actual 
number of predictors produced since it divides the mem- 
ory device into an access row and an access column and 
swaps and replaces the vertical predictors, horizontal pre- 
dictors and diagonal predictors, unlike the related art 
which has to store all predictors. To compare with the re- 
lated art, during the predictive decoding of a macro- 
block, the present invention only require a memory device 
with thirty-three memory cells (calculation based on em- 
bodiment in Fig. 7: the access column 56C[0-7], access 
column 56C[8-15], access row 56R[0-7] and access row 



56R[8-15] take up to 4*8=32 memory cells, with 1 addi- 
tional memory cell for the diagonal predictor). Even with 
the secondary memory device, a macro-block would need 
only an additional sixteen memory cells. 

[0055] In the embodiment, the memory size in the system is 
greatly reduced. For example for a whole picture (like a 
720x480 pixel sized), the size of the memory device 56 
reduced is very significant. Not only is the processing reg- 
ister based memory device usage reduced, the secondary 
memory device storage is also small, so the memory de- 
vice 56 illustrated in Fig. 7 (and the secondary memory de- 
vice 58) can be integrated into the system in an on-chip 
fashion, which reduces costs and continues the trend of 
integrating all video CODECs in one single chip. 

[0056] Those skilled in the art will readily observe that numerous 
modifications and alterations of the device may be made 
while retaining the teachings of the invention. Accord- 
ingly, the above disclosure should be construed as limited 
only by the metes and bounds of the appended claims. 



